Towards a Model of Prediction-based Syntactic Category Acquisition: First Steps with Word Embeddings
نویسندگان
چکیده
We present a prototype model, based on a combination of count-based distributional semantics and prediction-based neural word embeddings, which learns about syntactic categories as a function of (1) writing contextual, phonological, and lexical-stress-related information to memory and (2) predicting upcoming context words based on memorized information. The system is a first step towards utilizing recently popular methods from Natural Language Processing for exploring the role of prediction in childrens’ acquisition of syntactic categories.1
منابع مشابه
Running head : SENTENCE TYPES AND SYNTACTIC CATEGORIES 1 Adding sentence types to a model of syntactic category acquisition
The acquisition of syntactic categories is a crucial step in the process of acquiring syntax. At this stage, before a full grammar is available, only surface cues are available to the learner. Previous computational models have demonstrated that local contexts are informative for syntactic categorization. However, local contexts are affected by sentence-level structure. In this paper, we add se...
متن کاملLearning to Embed Words in Context for Syntactic Tasks
We present models for embedding words in the context of surrounding words. Such models, which we refer to as token embeddings, represent the characteristics of a word that are specific to a given context, such as word sense, syntactic category, and semantic role. We explore simple, efficient token embedding models based on standard neural network architectures. We learn token embeddings on a la...
متن کاملPerception Development of Complex Syntactic Construction in Children with Hearing Impairment
Objectives: Auditory perception or hearing ability is critical for children in acquisition of language and speech hence hearing loss has different effects on individuals’ linguistic perception, and also on their functions. It seems that deaf people suffer from language and speech impairments such as in perception of complex linguistic constructions. This research was aimed to study the pe...
متن کاملPhrasal prosody constrains syntactic analysis in toddlers.
This study examined whether phrasal prosody can impact toddlers' syntactic analysis. French noun-verb homophones were used to create locally ambiguous test sentences (e.g., using the homophone as a noun: [le bébésouris] [a bien mangé] - [the baby mouse] [ate well] or using it as a verb: [le bébé] [sourità sa maman] - [the baby] [smiles to his mother], where brackets indicate prosodic phrase bou...
متن کاملWord Sense Disambiguation of Arabic Language with Word Embeddings as Part of the Creation of a Historical Dictionary
A historical dictionary is a dictionary which deals with the detailed history of words since their first appearance in language as well as the evolution of their meaning and use throughout history. To create such a dictionary, we are bound to follow many steps. As part of these steps, the extracting of the appropriate meaning of a given word occurring in a given context, named also word sense d...
متن کامل